Multi-Perspective Context Matching for SQuAD Dataset
نویسندگان
چکیده
Question answering is an important task in machine comprehension. The new SQuAD dataset allows us to deploy recent NLP deep learning techniques and train an end-to-end system to predict the start and end position of the answer in the given context, instead of precisely selecting the words of the correct answer. We propose to use combine bi-directional LSTM (BiLSTM) and context matching to develop a model for SQuAD dataset. We first use two BiLSTMs to encode the context and question word sequence. Then we apply context matching from multiple perspectives to produce a matching vector. Finally another BiLSTM is applied to the matching vector to predict the start and end positions. Several other tricks are also explored to enhance the prediction accuracy. Experimental results show that our model can achieve an F1 score of 61.27 and EM score of 49.50 on the development set.
منابع مشابه
Question Answering with SQuAD: Variations on Multi-Perspective Context Matching
We implement multi-perspective context matching for the task of questionanswering on the SQuAD dataset and explore a variety of modifications to this core architecture. In our first modification, we compare the performance of GRUs with that of LSTMs in the original model. Next we attempt to predict the answer’s start index and length rather than its start and end indices. Finally, we introduce ...
متن کامل∗NQSotA Continuation Curriculum Learning with Question Answering on the SQuAD Dataset
We implement a slightly simplified Bi-Directional Attention Flow Model[4] and a slightly modified Multi-Perspective Context Matching[6] model for Question Answering on the SQuAD dataset. In the Multi-Perspective model, we add perspective matching between forward and backward contexts. We omit the character-level embeddings of both models, and make a few other small simplifications. We briefly l...
متن کاملReading Comprehension with SQuAD
The SQuAD dataset provides a reading comprehension task, with (question, answer, context) pairs. This paper attempts to develop a model to predict the answer for a given question, context pair. In a model inspired by ”Multi-Perspective Context Matching for Machine Comprehension” by Wang et al, this paper achieves 0.47 F1 score on a validation set.
متن کاملAssignment 4: Question Answering on the SQuAD Dataset with Part-of-speech Tagging
This research applies deep learning with bi-LSTMs to train a model that responds to queries on the Stanford Question Answering Dataset (SQuAD). The model design was motivated by Wang et. al.’s December 2016 IBM Research paper on multi-perspective context matching for machine comprehension. Using TensorFlow, we implemented a multi-layer neural network architecture utilizing bi-directional LSTMs ...
متن کاملMulti-Perspective Context Matching for Machine Comprehension
Previous machine comprehension (MC) datasets are either too small to train endto-end deep learning models, or not difficult enough to evaluate the ability of current MC techniques. The newly released SQuAD dataset alleviates these limitations, and gives us a chance to develop more realistic MC models. Based on this dataset, we propose a Multi-Perspective Context Matching (MPCM) model, which is ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2017